Morphing spectral envelopes using audio flow
نویسندگان
چکیده
We present a method for morphing between smooth spectral magnitude envelopes of speech. An important element of our method is the notion of audio flow, which is inspired by similar notions of optical flow computed between images in computer vision applications. Audio flow defines the correspondence between two smooth spectral magnitude envelopes, and encodes the formant shifting that occurs from one sound to another. We present several algorithms for the automatic computation of audio flow from a small 20 second corpus of speech. In addition, we present an algorithm for morphing smoothly between any two spectral magnitude envelopes, given the computed audio flow between them.
منابع مشابه
A Method of Morphing Spectral Envelopes of the Singing Voice for Use with Backing Vocals
The voice morphing process presented in this paper is based on the observation that, in many styles of music, it is often desirable for a backing vocalist to blend his or her timbre with that of the lead vocalist when the two voices are singing the same phonetic material concurrently. This paper proposes a novel application of recent morphing research for use with a source backing vocal and a t...
متن کاملGui Front-end for Spectral Warping
This paper describes a software tool developed in the Java language to facilitate time and frequency warping of audio spectra. The application utilises the Java Advanced Image Processing (AIP) API which contains classes for image manipulation and, in particular, for non-linear warping using polynomial transformations. Warping of spectral representations is fundamental to sound processing techni...
متن کاملVocal Effort Modification for Singing Synthesis
Vocal effort modification of natural speech is an asset to various applications, in particular, for adding flexibility to concatenative voice synthesis systems. Although decreasing vocal effort is not particularly difficult, increasing vocal effort is a challenging issue. It requires the generation of artificial harmonics in the voice spectrum, along with transformation of the spectral envelope...
متن کاملIndependent Manipulation of High-level Spectral Envelope Shape Features for Sound Morphing by Means of Evolutionary Computation
The aim of sound morphing is to obtain a sound that falls perceptually between two (or more) sounds. Ideally, we want to morph perceptually relevant features of sounds and be able to independently manipulate them. In this work we present a method to obtain perceptually intermediate spectral envelopes guided by highlevel spectral shape descriptors and a technique that employs evolutionary comput...
متن کاملSpectral Tools for Dynamic Tonality and Audio Morphing
Computer Music Journal Spectral Tools for Dynamic Tonality and Audio Morphing William Sethares [email protected], Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706 USA. Andrew Milne [email protected], Department of Music, P.O. Box 35, 40014, University of Jyväskylä, Finland. Stefan Tiedje [email protected], CCMIX, Paris, Fran...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005